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(54) Data network with voice verification means 

(57) A technique for verifying a user's voice prior to 
permitting the user to conduct a business transaction 
over a data network is disclosed. An order is received 
via the data network, and a voice verification unit is con- 



tacted to (i) access a p restored voice print, (ii) obtain a 
present voice sample from the consumer desiring the 
transaction and compare said present voice sample to 
the prestored voice sample, and (iii) issue a signal indi- 
cating whether or not the voice correctly verifies or not. 
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Description 

TECHNICAL FIELD 

This invention relates to data authentication, and 
more particularly, to an improved technique of verifying 
the identity of a user of a data network. 

BACKGROUND OF THE INVENTION 

The use of electronic mail, data networks, and other 
electronic communications has become widespread 
over the past several years. More and more businesses 
and individuals are becoming connected to data net- 
works, such as the internet, in order to communicate in- 
formation in a paperless manner. 

The growth in data network use has recently led to 
a wide variety of goods and services being offered to 
consumers who use such data networks. For example, 
many magazines are now available on line, airline tick- 
ets can be booked electronically, etc. 

One general category of available online services 
is consumer transactions. Consumers may purchase 
items by entering an account number to be billed, credit 
card, etc. The consumer can thus place an order for an 
item to be delivered to a specified location. 

One issue of concern is security, and more particu- 
larly, authentication. Specifically, the widespread use of 
data networks leaves open the possibility of theft of 
credit card numbers, passwords, and other information 
which a dishonest individual can use to charge purchas- 
es to the account numbers of others. 

While numerous technologies for encryption and 
cryptographic authentication exist, these technologies 
include several drawbacks. One such drawback is that 
the encryption usually involves a cryptographic key, and 
management and record keeping with respect to all of 
the different keyB is not a simple task. Moreover, some 
sophisticated mathematical algorithms exist which can 
decipher the cryptographic information, even without 
advance knowledge of the cryptographic key. Finally, a 
clever thief may have a technique to steal the crypto- 
graphic key, just as he may have a technique to steal 
the password previously utilized with a particular user, 
account number, etc. Accordingly, the encryption tech- 
nique is not completely reliable. 

In view of the above, it can be appreciated that there 
exists a need in the art for an improved technique of ver- 
ifying a particular user's identity before accepting pay- 
ment from that user or dispatching any goods or servic- 
es to that user, in order to ensure that the payment is 
not being sent from a stolen credit card number or other 
account number. 

SUMMARY OF THE INVENTION 

The above and other problems of the prior art are 
overcome in accordance with the present invention 



which relates to a technique of verifying the user's iden- 
tity by use of a voice print before allowing the user to 
engage in commercial transactions over the data net- 
work. In accordance with one embodiment of the inven- 

s tion, a voice verification unit is connected to the data 
network. The user's ID i6 ascertained by means of, for 
example, his data network address, and his stored voice 
print is retrievedf rom a voice print bank. The user is then 
asked to speak a few words, in order to verify the user's 

10 identity. TTie verification of the user's speech pattern 
may take place with the aid of a separate telephone call 
initiated by either the voice verification unit or the user's 
computer and/or telephone, or by the computer accept- 
ing and processing the transaction. The verification may 

is take place by transmitting the voice in digital form over 
the data network. 

BRIEF DESCRIPTION OF THE DRAWINGS 
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Figure 1 shows portions of a voice network and a 
data network, both connected to a voice verification 
unit in accordance with the present invention; and. 

Figure 2 shows a flow chart for implementing the 
basic steps necessary for practice of the present in- 
vention. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENT 



Figure 1 shows a conceptual diagram of an exem- 
plary embodiment of the invention including a voice ver- 
ification unit 103 connected to a data network 101 and 
a voice network 1 02. As shown in Figure 1 , the data net- 

35 work 101 includes a plurality of computers 105 and a 
plurality of telephones 104, several of which are shown. 

Lines 1 07 are shown as connecting the voice veri- 
fication unit 103 to the data network 101, while lines 106 
are indicated as connecting the voice verification unit to 

40 the telephone network 102. It is noted that each of the 
networks 101 and 102 is shown separately. However, 
as is known to those of ordinary skill in the telecommu- 
nications art, computers 105 and voice verification unit 
103 may connect to the data network by utilizing a por- 

45 tion of the telephone network and a modem. The net- 
works are shown separate, and are separate logical net- 
works, but are not intended to be entirely physically sep- 
arate. 

The difference between the networks is effectively 
so the set of addresses used to address each terminal. 
Specifically, each connection to the data network has a 
particular logical address with a specific name, while 
each connection to the telephone network has a partic- 
ular logical address with a specific telephone number. 
& As is also known in the art, a user of computer 105 
may access the data network, as well as other comput- 
ers connected to the data network, from many different 
telephone numbers, but the address on the data net- 
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work will be the same, irrespective of from which tele- 
phone number said data network is entered. Additional- 
ly, a single particular telephone line may be utilized, at 
different times, to provide access to the data network for 
data network users that have different logical address- 
es. Accordingly, the networks are logically separate in 
terms of their different sets of address spaces, even 
though there may be some physical overlap between 
the two networks 101 and 102. 

Voice verification unit 103, which will be described 
more fully hereafter, is utilized in order to provide secu- 
rity when a user of the data network 105 engages in a 
commercial transaction via the data network 101 . Vbice 
verification unit 103 may communicate with computers 
105 and\or telephone terminals 104, as one or both may 
be necessary for the performance of the functionality of 
voice verification unit 103 as set forth hereafter. 

Consider an exemplary transaction whereby a user 
of computer 105a is desirous of purchasing a service 
from a vendor. The vendor operates computer 1 05c. Ad- 
ditionally, each user of data network 101 is known to the 
data network 101 as a predetermined logical address. 
Such an arrangement is typical of the internet, where all 
users must register their internet domain name. 

In one exemplary mode of operation, the user's 
voice is stored in advance of the transaction at the stor- 
age unit of voice verification unit 103. This storage may 
take place, for example, when the user first registers 
with the data network to obtain the user's logical ad- 
dress. For example, when the internet domain name is 
entered, a live operator or voice processing system 
could be utilized to accept a voice print of predetermined 
duration or words. Details of how to accomplish this are 
described later herein. 

Presuming the voice is prestored at the voice veri- 
fication unit, when a user of computer 105a desires to 
engage in a purchase from a vendor that operates com- 
puter 105c, the user of computer 1 05a transmits the rel- 
evant ordering information and payment method. The 
payment method could be, for example, either a bank 
account number or credit card number. Alternatively, a 
deposit account could be established when the user's 
voice is registered at WU 1 03. 

The computer 1 05c must verify the user's voice pri- 
or to allowing the transaction. In order to accomplish 
such verification, computer 105c transmits the user's 
logical address for data network 101 to voice verification 
unit 103 in accordance with standard data transmission 
techniques of protocols utilized in data network 101. 
Voice verification unit 103 then maps the received logi- 
cal address to the prestored voice print and reads the 
prestored voice print into its working memory. 

The next task for voice verification unit 103 is to ob- 
tain a present sample of the user's voice. One exempla- 
ry technique for accomplishing this is for voice verifica- 
tion unit 103 to call the user on a predetermined, or user 
specified, telephone numberthrough telephone network 
102 and prompt the user to speak particular words into 



thetelephone. Other techniques are also described later 
herein. 

An alternative technique, if the user's computer 
1 05a has a microphone, is for the user to input his voice 
s print at computer 105a when he places the order. For 
example, computer 105c could transmit a message to 
computer 105a, in response to the order from computer 
105a. The message, which would be displayed on the 
screen of the user's computer, would read "Please 
10 speak the following words into your computer's micro- 
phone....' or 'Please speak your password into your 
computer's microphone." By utilizing a password in con- 
junction with voice verification, two levels of security, are 
provided. Computer 105c would then transmit the logi- 
cs cat address of computer 105a, along with the acquired 
voice, to voice verification unit 1 03. The voice could then 
be sent over the data network,, in digital form, in accord- 
ance with known techniques. 

In any event, regardless of the protocol used to ob- 
tain the present voice sample, voice verification unit 1 03 
compares the voice acquired at transaction time to the 
prestored voice, and returns to computer 105c a signal 
indicating acceptance or rejection of the voice compar- 
ison. 

Figure 2 shows a conceptual flow chart of the steps 
to be executed by computer 105c operated by the in- 
ventor. After start 201 . the logon protocol is executed at 
block 202. Logon protocol is any standard protocol 
which, for example, may require the user to enter a 
password, or any other relevant information. The user 
then orders a particular service or product at block 203, 
which order includes an appropriate account number to 
which charges should be made. The account number 
may be a bank account number, credit card number, or 
other information. 

Prior to filling such order, the voice sample is re- 
quested at block 204. The voice sample may be request- 
ed in one of several ways. One technique is to print a 
message on the user's terminal requiring the user to call 
a particular telephone number. Included in such a mes- 
sage is an identification number ("transaction ID") which 
uniquely identifies the transaction. The transaction ID is 
similar to a purchase order number. The transaction ID 
may be generated, for example, by utilizing a hashing 
operation to act upon the data related to the transaction, 
although other methods may be used as well. 

The transaction ID is utilized in order to be able to 
pair the voice sample entered at the time of transaction 
with the prestored voice sample. In one simple embod- 
iment, the transaction I D may be the user's data network 
address. 

A message would be sent to the user's terminal, 
stating something such as "Please call 1 -800-1 23-4567. 
Enter transaction ID ABCD, and speak your pass- 
word...." The 800 number connects the consumer's tel- 
ephone to computer 105c. 

Upon receipt of the telephone call, the computer 
105c receives the current voice sample and pairs the 
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current voice sample with the particular transaction in 
question, based upon the transaction ID, in order to con- 
nect the current voice sample with the particular user. 
Alternatively, the pairing of the voice sample with the 
transaction may be based upon either the user's data 
network address or upon his logon password. The 
record containing the voice sample and other informa- 
tion may then be sent to the voice verification unit at step 
206. 

Alternatively, rather than having the voice sample 
taken at computer 105c, computer 105c could transmit 
the message to computer 105a while at the same time 
transmitting, via data network 1 09, the transaction ID to 
the voice verification unit 1 03. The voice verification unit 
103 would then receive the toll free, telephone call, or 
may receive the voice sample from the data network 
1 01 , from the user. Of course, the voice verification unit 
103 could place the call as well, voice verification unit 
103 may then verify the voice received, voice verifica- 
tion unit 1 03 could then send the approval with the trans- 
action ID or data network logical address back to com- 
puter 105c. 

In any of the above cases, subsequent to the voice 
sample being received from the consumer, block 205 
transmits the appropriate information from computer 
105c to voice verification unit 103. The information may 
include the transaction entered by the user during a tel- 
ephone call, as well as the voice sample, Alternatively, 
if the voice sample was received directly at the voice 
verification unit 103, then the record would include only 
the transaction IDso that the voice verification unit could 
match the transaction ID received from the user with thai 
generated by computer 105c. 

In any event, the assembled record is transmitted 
at block 206 to the voice verification unit 103 for process- 
ing. At block 207, the voice verification unit sends the 
appropriate answer back to computer 104. If the voice 
is verified as correct, then the transaction is processed 
at block 208. As also shown in Figure 2, if the voice is 
not verified as correct, then the transaction is rejected, 
or alternatively, the user may be asked to reinput the 
voice sample, just in case the first sample was inappro- 
priately corrupted. 

In addition to the above, other embodiment lor ob- 
taining a present voice sample and comparing it to a 
stored voice print are possible. For example, the 
prestored voice sample could be- a chosen password. 
The voice verification unit, when prompting the user to 
enter his voice, could cause a message to be displayed 
on the user's terminal stating "Please speak your pass- 
word." Such a system adds an extra level of security by 
requiring any potential intruder to not only be able to im- 
itate a party's voice, but to know the password. Addition- 
ally, should a party enter the correct password with the 
incorrect voice a predetermined number of times, the 
system could recognize a potential theft of the password 
and take a desired action such as prompting the user to 
change the password. 



The voice verification unit may not be certain from 
which telephone number the user is accessing compu- 
ter 105c. Accordingly, WU 103 could display on com- 
puter 105a a message sating 'Please input a telephone 
s number at which you can be reached, or enter ### if you 
can not be called." Thereafter, the user will be called and 
prompted for a voice sample, or, if he entered ###, will 
be given a predetermined time, say two hours, to call 
the WU 1 03 and enter a voice sample. If the user made 
io the call within the two hours, he would be required. Oth- 
erwise, the transaction will be cancelled. 

The WU 1 03 could be combined with, or made part 
of, computer 105c. Specifically, each transaction com- 
puter can have its won database of voice prints, or the 
voice prints can be centrally stored in WU 103. Alter- 
natively, the WU 1 03 could store all the voice prints and 
simply forward them to computer 105c for processing 
and/or comparison. 

The circuitry required to implement the voice and 
data recognition functions is well known to those of or- 
dinary skill in the art and will not be described in detail 
herein. Suffice to say that a typical PC based voice 
processing system may be utilized at both voice verifi- 
cation unit 103, and as part of computer 105c. 

With regard to obtaining the voice print for storage 
at the voice verification unit 103, one possible protocol 
recognizes the user's initial logon. Specifically, when the 
user logs on for the first time, the system connects him 
to the voice verification unit. The applications program 
in the voice verification unit sends a prompt message to 
the computer 105. The prompt message is displayed on 
the screen requesting that the user enter his or her 
voice. The voice is then stored in voice recognition unit 
103, along with an associated user ID or password. 

It is understood that while the above describes the 
preferred embodiments of the invention, various other 
modifications may be made without departing from the 
spirit or scope hereof. One enhancement involves tak- 
ing into account the fact that verification algorithm may 
return a level of certainty rather than a binary digit The 
system could allow transactions to occur if, for example, 
the WU 103 returns an answer indicating that there is 
at least an 80% likelihood that the user is authentic. Dif- 
ferent levels of certainty could be required for different 
monetary levels of transactions. 

The voice print can be obtained by a data network 
or telephone network connection, either of which can be 
initiated by computer 105a, computer 105c, or WU 103. 
It is also possible to utilize characteristics other than 
voice, such as fingerprints, retina characteristics, or oth- 
er properties which are unique to an individual. 

Other variations invotve allocating one or more of 
the computing functions discussed above in the same 
or different computers. Specifically, one can viewthe de- 
scribed system as having the following four computing 
functions: (i) transaction junction, for accepting a con- 
sumer transaction (ii) an acquisition function, for acquir- 
ing a present voice sample to verify before function, for 
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acquiring a present voice sample to verify before allow- 
ing the transaction (iii) a storage function, for storing 
samples of numerous previously obtained voice prints 
to be used for comparison and verification during trans- 
actions, and (iv) a comparison function for comparing 
the voice sample obtained during the transaction to the 
previously stored voice print. 

The embodiment shown in Figure 1 hereof contem- 
plates two computers 1 05c and 1 03 which implement all 
four functions. However, it is possible to allocate the four 
functions differently, and among any number of comput- 
ers. For example, the transaction computer 105c could 
include a copy of all voice prints of authorized users. 
Upon a transaction occurring, computer 105c could ac- 
quire a present voice sample and verify the sample 
against a previously stored voice print prior to allowing 
the transaction. In such an embodiment, all four of the 
functbns discussed above are implemented in compu- 
ter 105c, and the separate voice verification hardware 
is eliminated. Other embodiments are possible as well. 

The above describes the preferred embodiments of 
the invention. It is understood however, that various oth- 
er modifications and additions will be apparent to those 
of ordinary skill in the art. 



Claims 

1 . A system for permitting users to transact data over 
a data network only if the user's voice is verified, 
said system comprising: 

a first network; 

a second network for transmitting data in ac- 
cordance with said transactions; and 
means for verifying a user's voice by means of 
the first network prior to proceeding the said 
transaction. 

2. A method of transacting business over a data net- 
work comprising the steps of; 

accepting an order for a transaction from a con- 
sumer; 

displaying a message on a computer screen of 

said consumer, said message advising said 

consumer to enter his/her voice; 

receiving said voice sample and comparing 

said voice sample to a prestored voice sample; 

and 

permitting said business transaction only if said 
voice sample correctly verifies. 

3. A method of verifying a user's voice prior to allowing 
said user to engage in a particular transaction over 
a data network comprising the steps of: 

obtaining, in advance of said transaction, voice 



samples from numerous users of said data net- 
work; 

storing said samples in a voice verification unit; 
accepting at a transaction computer, a desired 
transaction; 

prompting said consumer over said data net- 
work, substantially at the time of said desired 
transaction, to enter a present voice sample; 
transmitting said present voice sample from 
said transaction computer to a voice verification 
unit over the data network; and 
transmitting a response from said voice verifi- 
cation unit to said computer accepting said 
transaction, said response indicating whether 
said voice correctly verifies or not. 

4. A method of verifying a user's voice prior to permit- 
ting the user to engage in a transaction over a data 
network between a user's computer and a computer 
providing a consumer service, said method com- 
prising the steps of: 

maintaining a database of voice prints at a 
voice verification unit, said database including 
a plurality of voice prints, each of said voice 
prints being associated with a particular user; 
receiving at said voice verification unit, from 
said computer providing a consumer service, 
information sufficient to ascertain the user de- 
siring to engage in said transaction; 
receiving a present voice sample from said us- 
er; 

verifying said users identity at said voice verifi- 
cation unit; and 

transmitting, to said computer providing a con- 
sumer service, an indication of whether said 
identity has been correctly verified. 

Apparatus for verifying a user's voice comprising: 

means for logging on as a first logical address 
to a data network; 

means for accessing a telephone network from 
a second logical address; 
means for storing voice prints of a plurality of 
of said data network, and means for receiving 
voice samples from either the data network or 
the telephone network, and for verifying the 
samples against the voice prints. 

Apparatus for verifying a user's voice prior to allow- 
ing a transaction to take place, said apparatus com- 
prising: 

means for storing a plurality of voice prints, said 
voice prints corresponding to voices of poten- 
tial consumers desiring to engage in a transac- 
tion; 
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means for accepting a transaction from a con- 
sumer; 

means for acquiring a voice sample from said 
consumer prior to allowing said transaction; 
and 5 
means for comparing said voice sample to a 
voice print corresponding to said consumer, 
and for allowing said transaction only if said 
comparison indicates a match to within a pre- 
determined degree of certainty. 10 

7. Apparatus of claim 6 wherein said means for storing 
and said means for acquiring are on separate com- 
puter systems. 

75 

8. Apparatus of claim 6 wherein said means for ac- 
cepting and said means for acquiring are on a single 
computer system, and said means for storing is on 
a separate computer system. 

20 

9. Apparatus of claim 6 wherein said means for stor- 
ing, acquiring, accepting and comparing are all on 
one computer system, 

10. Apparatus of claim 6 wherein said means for ac- 25 
cepting acquiring and comparing are on a first com- 
puter system and said means for storing is on a sec- 
ond computer system. 
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